Discrete time McKean-Vlasov control problem: a dynamic programming approach
نویسندگان
چکیده
We consider the stochastic optimal control problem of nonlinear mean-field systems in discrete time. We reformulate the problem into a deterministic control problem with marginal distribution as controlled state variable, and prove that dynamic programming principle holds in its general form. We apply our method for solving explicitly the mean-variance portfolio selection and the multivariate linear-quadratic McKean-Vlasov control problem. MSC Classification: 60K35, 49L20
منابع مشابه
Linear quadratic optimal control of conditional McKean-Vlasov equation with random coefficients and applications
We consider the optimal control problem for a linear conditional McKeanVlasov equation with quadratic cost functional. The coefficients of the system and the weighting matrices in the cost functional are allowed to be adapted processes with respect to the common noise filtration. Semi closed-loop strategies are introduced, and following the dynamic programming approach in (Pham and Wei, Dynamic...
متن کاملDynamic Programming for Optimal Control of Stochastic McKean-Vlasov Dynamics
We study the optimal control of general stochastic McKean-Vlasov equation. Such problem is motivated originally from the asymptotic formulation of cooperative equilibrium for a large population of particles (players) in mean-field interaction under common noise. Our first main result is to state a dynamic programming principle for the value function in the Wasserstein space of probability measu...
متن کاملBellman equation and viscosity solutions for mean-field stochastic control problem
We consider the stochastic optimal control problem of McKean-Vlasov stochastic differential equation where the coefficients may depend upon the joint law of the state and control. By using feedback controls, we reformulate the problem into a deterministic control problem with only the marginal distribution of the process as controlled state variable, and prove that dynamic programming principle...
متن کاملLarge Population Stochastic Dynamic Games: Closed-loop Mckean-vlasov Systems and the Nash Certainty Equivalence Principle
Abstract. We consider stochastic dynamic games in large population conditions where multiclass agents are weakly coupled via their individual dynamics and costs. We approach this large population game problem by the so-called Nash Certainty Equivalence (NCE) Principle which leads to a decentralized control synthesis. The McKean-Vlasov NCE method presented in this paper has a close connection wi...
متن کاملA Defined Benefit Pension Fund ALM Model through Multistage Stochastic Programming
We consider an asset-liability management (ALM) problem for a defined benefit pension fund (PF). The PF manager is assumed to follow a maximal fund valuation problem facing an extended set of risk factors: due to the longevity of the PF members, the inflation affecting salaries in real terms and future incomes, interest rates and market factors affecting jointly the PF liability and asset p...
متن کامل